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(54) Individuolrty discriminating 
system 

(57) An mdividuality discriminating 
system comprises a TV camera (12) for 
viewing an Individual, an A/O convertor 
(13) for converting analog signals of the 
individual picture to digital signals 
according to the brightness of the 
analog picture, a memor/ (14) for 
storing the digital signals, a 
compressor/coder circuit (1 7) for 
compressing the digital picture data 
and a writer (19) for writing the 
compressed picture data in an 
integrated-circuit (IC) card (20). In using 
the IC card by rts bearer the thus stored 
data are read out of the card by a reader 
(21), expanded and analog-converted 
by an expander/decoder circuit (22) and 
displayed on a monitor (23). Since the 
picture data are compressed to reduce * 
the code volume of the data stored in 
the card (20), the individuality 
discrimination can be realized precisely 
and reliably through an investigator's 
visual comparison of the thus displayed 
picture with the bearer or monitored 
picture of the (remote) tsearer. Picture 
elements other than changed ones in 
the picture are treated as zero picture 
elements. 
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SPECIFICATION 

Individuality DIscrimlnatlna Syvtsm 

This fnvention relatoa to an Individuality discriminating system employing an- integrated-circuit (IC) 
card and, more particularly, to a flystem in which picture data of card-bearing tndtvlduat are stored in the IC 
5 card and, in using the card for identification purpose, the picture data are read out of the card and g 
monitored for visual comparison by an investigetor of the monitored picture with directly monitored picture 
of the Individual himself. 

This individuality discriminating system is useful in providing a precise persona I. Identity recognition, 
when the IC card of the system is utilized as a credit card, cash card (for use with automatic cash 
10 drawing/depositing machines at banks), or the like which is employed in any other system requiring the i q 
identity recognition. 

In the system employing the card of the kind referred to for transactions^ generally, a specific code such 
as a personal identification number is recorded by a magnetic means In the card and, in using the card, the 
system allows the transaction to proceed automatically when, for example, the code manually given by the 

1 6 user to the system conforms to the code read out of the card. In this case, there arises a problem that a 15 
person other than the bona fide card-user may get the card and use it with the code stealthly read out of the 
card, and a demand has been to improve the system in this respect. 

To eliminate the problem, there has been suggested, for example, in Japanese Patent Appln. Laid-Open 
Publication No. 56-17465 (1 981 ) by A. Kawaguchi a system wherein, in addition to the specific code 

20 magnetically recorded In the card as has been known, a picture data of the card-bearer's face is stored in the 20 
card. In this case, the picture data are stored by monitoring the bearer's face, photo-electrically converting 
picture elements of the monitored image Into electric signals and then converting the electric signals Into 
binary data according to light and shade of the picture elements. Upon each use of this card, on the other 
hand, the bearer's face Is directly monitored simultaneously with code and data reading operation out of 

25 the card, picture elements of the directly monitored face picture are converted also to the binary data 25 
through the same steps as in the case of storing the face picture data In the card, and the directly monitored 
binary data are compared by a comparator with the stored binary data for recognition of the identity of thd 
bearer. 

This system of the Japanese publication has been an improvement in achieving a more reliable identity 

30 recognition than the known systems emptoying the card having only the specific code. However, the card 30 
used in the system referred to is neariy of the same size as that of playing cards and the storage capacity of 
the card Is limited to be a bar to an incremental storing of required data for any higher precision identity 
recognition. In other words, realization of the higher precision identity recognition calls for a remarkable 
increase in the face picture elements to an extent of about 256x256, exceeding largely the storage capacity 

35 of the card, and the realization is practically difficult. Yet, the increased number of the face picture elements 35 
causes another problem to arise in inherent complication and enlargement of such discriminating means as 
the comparator that render the manufacturing costs to become high. In addition, since human face often 
greatly changes due to emotion or the like factor, there is a risk that such higher precision discrimination 
requiring the comparator or the like may rather cause frequent errors. For this reason, it has been 

40 demanded to realize a reliable discriminating system which Is of a high precision but still allows an effective 40 
utilization of human sense of vision. 

Even if, on the other hand, an improvement has achieved an enlarged storage capacity of the IC card, 
the thereby increased number of the data for the high precision recognition might bring about still another 
problem that required time for displaying the stored picture data of the card is elongated, because the data 

45 have to l?e read out sequentially bit by bit 45 
A primary aim of the present invention is, therefore, to provide an individuality dis<^riminating system 
which allows sufficient picture data for discriminating human individuality at a high precision to be stored 
in a card substantially of the same size and storage capacity as ordinary credit, cash and the like cards, the 
overall system arrangement to be still kept simpler and inexpensive, the discrimination reliability to be 

60 Increased by enabling visual discrimination utilizable, and further the discrimi nation to be performable at a 60 
high speed. 

According to the present invention, this aim is realized by providing an individuality discriminating 
system which cohnprises means for monitoring a picture of an objective person, means for converting 
analog picture data from the monitoring means Into digital data according to brightness of the analog 
55 picture data and compressing the digital picture data, means for writing compressed picture data into a card 55 
for use by the objective person, means for reading the compressed picture'data out of the card and 
expanding them to convert into the analog data, and means for displaying the expanded analog picture 
data. 

The invention will now be further described, by way of example, with reference to the drawings, in 
60 which:— 60 
Rgure 1 is a block diagram of an individuality discriminating system according to the present 
invention; 

Rgure 2 is a more detailed block diagram of a human figure extractor circuit and a compressor/coder 
circuit in the system of Figure 1 ; and 
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Rgure 3 la a block diagram In another embodiment of the Individuality discriminating system of Rgure 
1 for a remote discrimination. 

While the present invention shall now be described with reference to the preferred embodiments 
shown in the dravvings. It should be understood that the intention Is not to limit the invention only to the 
6 particular emhodlmonts shown but rather to cover alt alterations, modifications and equivalent g 
arrangements possible wYthIn the scope of appended claims. 

Referring to Rgure 1r an individuality discriminating system 10 according to the present invention 
comprises a picture processing section 1 1 which receives picture signals from a TV camera 12 which Is 
provided for monitoring a user of a system for recognizing the identity of every user wrth use of such a card 
10 as a credit card, cash card, gate-pass card for a restricted area, or the like card. The picture processing iO 
section 11 includes an A/D converter 13 which receives the picture signals directly from the TV camera 12 
and converts the signals to digital signals of, for example, 6 to 8 bits In accordance with the light and shade 
of picture elements, i.e., brightness information of the monitored picture, and the digital signals of the 
picture are stored in a frame memory 14 connected to tha A/D converter 13. 
1 5 The digital picture signals stored In the frame memory 14 are compared at a human fTgure extractor 1 B 

drcuit 1 5 with background picture signals sent from a twckg round picture frame buffer 1 6 to extract only 
signals indicative of such a part of the user as face. The extracted picture signals are provided to a 
compressor/coder circuit 1 7 where the extracted picture signals are compressed, for example, two- 
dimensionally as will be described later, according to a compression parameter received from a parameter 
20 setting circuit 18. The extracted picture signals thus compressed are then provided from the circuit 17 to a 20 
writer 19 where. If such an IC card 20 as the credit, cash or the like card Is held Inserted In the writer 19, the 
compressed signals of the objecth/e person, i.e., the card user are stored In the card 20 as picture data of 
bona fide card-user. The IC card 20 should be fabricated in accordance with ISO standard (International 
Organization for Standardization) and may comprises DP7816/1 or DP7816/2 incorporating memory chips. 
25 In using the IC card 20, the user Inserts the card 20 into a card reader 21 which reads the picture data 25 
stored as compressed in the card and sends them to an expander/decoder circuit 22 for their expansion and 
ijecoding. The expander/decoder circuit 22 includes a D/A converter (not shown) which converts the digital 
picture data to analog signals which are sent to a monitor 23, so that the picture data of the bona fide 
card-user will be displayed on the monitor 23, and an investigator will usually compare the thus monitored 
30 picture directly with the user's face as observed with the investigator's eyes. It will be appreciated that even 30 
when the user changes his face expression emotionally or Intentionally, the direct observation can cope 
with such change and the identity can be reliably Investigated. 

The foregoing human figure extractor circuit 1 5 and compressor/coder circuit 17 are arranged 
optimumly as shown in Rgure 2, in which instance the extractor circuit 15 includes a changed picture 
35 element extractor circuit 1 51 which receives the signals directiy from the frame memory 14 and background 35 
picture frame buffer 1 6. in the changed picture element extractor drcuit 1 51 , the digital picture signals of the 
user monitored with a predetermined background for the storage and received from the frame memory 14 
Is compared, with respect to every picture element, with the background picture signals of the entire 
predetermined background stored fn advance In the background picture frame buffer 1 6, so as to extract 
40 such picture elements in the user's digital picture signals that are changed or largely different from a 40 
predetermined set value given to the extractor arcuit 1 51 , and only the picture signals for the user's face are 
generally extracted. 

The thus extracted picture signals are sent to an Isolated-point eliminating circuit 1 52 to remove any 
isolated point which may appear on the boundary line of small change between the user's figure and the 

45 background, within the zone of the user's figure of changed picture elements or the like position in the 45 
picture signals. After such isolated-point elimination, the picture signals are provided to a binarlzing circuit 
153, the picture signals binarized in the circuit 153 are sent to a contour extractor circuit 154 to clarify the 
contour of the user's figure by means of a conversion into a chain code or the like, and then the binarized 
picture signals thus clarrfled in the contour are provided to a head-part extractor circuit 155 to extract a 

50 picture corresponding to the user's head part as bounded by narrower neck portion, so that only face part in 50 
particular of the user's picture of the changed picture elements can be obtained. 

Further in the human figure extractor circuit 1 5 of Rgure 2, the picture signals may be sent from the 
fsolated-point eliminating circurt 152 to a picture clipping circuit 156 to clip the face part picture, so long as 
the extraction of the picture signalsat the changed picture element extractor circuti 151 is satisfactory. The 

55 arrangement may be also made so thatthe picture signals from the isolated-point eliminating circuit 152 are 55 
differentiated at a differentiating circuit 1 57 and binarized through a binarlzing circuit 158 to be binary 
picture signals, which are provided to a line dravnng generator circuit 1 59 to property divide the picture 
signals into regions respectively including such an individuality-featuring part as eye, mouth or the like part, 
and are then sent to the head part extractor circuit 1 55 as well as to a picture clipping circuit 1 56 to obtain 

60 the face part picture, in particular, a dipped picture corresponding to one of the regions containing the 60 
Individuality-featuring part. 

On the other hand, the compressor/coder circuit 17 includes a quantizer circuit 171 which receives the 
clipped picture signals from the picture clipping circuit 156. At the previous stage of the quantizer circurt 
171, an intertine predictive decoder circuit 172 and an intraline predictive decoder circuit 173 are inserted to 

65 provide their outputs to the picture clipping circuit 156. In the quantizer and interiine and intraline predictive 65 
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decoder cfrcufts 171 , 172 and 173, other picture elements than such changed picture elements as those of 
the face part picture are decoded as zero picture element, the decoding being perfbrmed reliably by, at 
beginning and of the changed picture elements on each line, utilizing as predlcth^a decoding value an 
interline predictive decoding value for corresponding picture elements on a previous line and, at 
6 terminating end of the changed picture elements on the line, overshooting any zero picture element 6 
preferably to minus value. Zero picture elements and zero codes In the light and shade of the thus obtained 
face picture or. In other words. Its brightness Information are compressed on run length basis at a zero 
code^zero line compressor circuit 174connected to the quantizer circuit 171. It will be seen that the picture 
data can be compressed to a remarkably reduced amount of code of only the area thatthe changed picture 

10 elements are occupying, in this case, the parameter setting circuit 18 shown in Rgure 1 may be Included, for i o 
example. In the compressor circuit 174. For the purpose of reducing the data amount to be stored in the 
card, it will be also effective to elevate the compression rate only for a part of the facte to be higher than that 
for other parts. It Is preferable that, as predictive Inputs of the Interline predictive decoder and Intraiine 
predictive decoder circuits 172 and 173, so^ailed previous-value prediction (DPCM) value employed for a 

1 5 previous individualrty discriminatton, and the quantation code characteristics will be given, for example, as 15 
in a following Table: 
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While the two dimensional compression has been carried out on the prevlous-vatue prediction basis in 
the foregoing embodiment, the compression may be also carried out by means of a so-called variable 
sampling rate coding. Further, Instead of such two dimensional compression involving the decoding as in 
the foregoing embodiment, a mere single dimensional compression may be employed, in which event the 

35 quantization code characteristics may be the same as, for example, as those in the above Table but, since 35 
the single dimensional compression involves no interlme prediction nor decoding, the Initial value of the 
previous picture elements on the same line, that is, the predictive decoding value for the line is used as the 
initial value of the changed picture elements in the foregoing embodiment. In an event where the changed 
picture elements change to zero elements, the arrangement should be made in such that a compression 

40 code "E" which always causes the overshooting is provided to the picture elements so as to render them to 40 
be zero or minus value and to render the minus value to be zero, whereby zero values can be treated as zero 
picture elements, other values than the zero values can be treated as the changed picture elementSi and the 
zero picture elements can be compressed. 

While In the foregoing embodiment of Rgures 1 and 2 the processing is made with respect to the light 

45 and shade of the picture data, t.e., the brightness information, further, an additional processing as to color 45 
information for the picture elements will allow the individuality discrimination to be realized at a higher 
accuracy. In that event, the compression performed merely in the same manner as the compression based 
on the brightness information in the foregoing embodiments may cause a risk to arise in that a predictive 
error or a quantization error causes colors to drift or spread. Since colors are expressed in terms of ratios of 

50 B» G and B color components, the color information can be made to be of 2 or 3 bits for each of the R, G and 50 
B color components for being quantized and compressed to be stored in the card together with the 
brightness Information, so that they can be expanded and decoded for reading out 

According to another feature of the present Invention, a remote investigation for the individuality 
discrimination can be realized by allowing the visual comparison to be made on two monitors. Referring to 

55 Figure 3, there Is shown another embodiment of the individuality discriminating system according to the 55 
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prment rnvention. In which substantially the same means as those in Rgure 1 are denoted by the same 
reference numerals but added by 200. In the embodiment of Figure 3, the picture data stored In an IC card 
220 are displayed on a monitor 223 through a card reader 221 and an expander/decoder drcuft whereas 
the user of the IC card 220 la monitored by an Investigating TV camera 212 and displayed on a monitor 223a 
5 through a picture transmission section 212a« so that the Investigation can be conducted at an Investigating 6 
position remote from a position of the card reader Into which the user Inserts the cerd, with a visual 
comparison of the two pictures on the both monltora 223 and 223a at the remote investigating position. 

According to the above feature, the system may be also arranged In such that an operating unit 
operatively associated with the system and with an automatic transaction unit of a transaction system 

1 0 employing the credit card or a cash card Is installed at the remote Investigating position, so that the i q 

automatic transaction unit will be activated through the operating unit only when the Investfgstor or an 
operator of the entire system discriminates the Individuality of the card user through the visual comparison 
of the monitored pictures. 

It is also possible to use the Individuality discriminating system according to the present Invention In 

1 5 assodatlon with an existing system employing known Identification (ID) cards on which such specific code 1 5 
as the personal identification numt>er is recorded by the known magnetic means. It will be further 
appreciated that the Individuality discriminating system of the invention based on the visual comparison 
discrimination can be used together with any known automatic picture data comparing and discriminating 
system so that, when any error or false discrimination takes place in such known system, the system of the 

20 present Invention can execute the Indi\^duallty discrimination as a follow-up system so as to perform a 20 
double discrimination. In carrying out the visual comparison discrimination in the aspect of Figure 3, 
further, the user's picture data of the changed picture elements can be displayed in place of a part of or as 
embedded in a standard or predetermined background picture preilmmarily stored in the expandor/decoder 
ctrcurt, upon expansion and decoding of the changed picture elements forming the user's picture, as will be 

25 readily appreciated. 26 
Yet according to the present invention, the preparation of the card involving such characteristic 
compressing arrangement as has been referred to makes ft possible to effectively prevent any forgery of the 
card from being performed. 



CUMMS 

30 1 • An individuality discriminating system comprising means for monitoring an objective individual, 30 
• means connected to said monitoring means for digitizing an analog picture from the monitoring means Into 
digital picture data according to brightness of said analog picture and compressing said digital picture data, 
means for writing said compressed picture data in a card to be used by said Individual, means for reading 
said picture data out of said card through expansion and analog conversion of the compressed data, end 

35 means connected to said reading means for displaying said expanded analog picturedata. 35 

2. A system according to claim 1 , wherein said digitizing and compressing means compresses other 
picture elements^than changed picture elements of said picture data as zero picture elements. 

3. A system according to daim 2, wherein said changed picture elements are of human figure in said 
picture data and said other picture elements are of a background in the data. 

40 4. A system according to claim 2, wherein said digitizing and compressing means clips face picture off 40 
from said picture data. 

5. A system according to claim 4, wherein said digitizing and compressing means further clips part of 
said face picture and compresses said clipped face part at a compression rate higher than that for other 
parts, 

45 6. A system according to claim 1 which further comprises another means for displaying said objective 45 
tndtviduat directiy monitored upon his use of said card in addition to said displaying means for said picture 
data read out of the card, said read-out data displaying means and said direct individual displaying means 
both being disposed at a position remote from a region in which the card Is being used, so as to allow t>oth 
of said displaying means to be visually compared with each other for said individuality discrimination at 

50 said remote position. 50 

7. Asystsm according to claim 1 which further comprises means installed along with said read-out data 
displaying means and interconnected to an automatic transaction unit of a card-utilizing automatic 
transaction system for operating said transaction unit, said operating means being operated by an operator 
who has visually recognized the identity of said Individual who has used said card to said picture data 

55 displayed by the read-out data displaying means, and said transaction unit being tiiereby activated. 55 

8. A system according to claim 1, which is used together with an automatic picture discriminating 
system for performing the individuality discrimination in double. 

9. An Individuality discriminating system substantially as described herein with reference to the 
drawings. 
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